Optimum Tradeoffs Between the Error Exponent and the Excess-Rate Exponent of Variable-Rate Slepian-Wolf Coding

نویسندگان

  • Nir Weinberger
  • Neri Merhav
چکیده

We analyze the asymptotic performance of ensembles of random binning Slepian-Wolf codes, where each type class of the source might have a different coding rate. In particular, we first provide the exact encoder excess rate exponent as well as the decoder error exponent. Then, using the error exponent expression, we determine the optimal rate function, namely, the minimal rate for each type class needed to satisfy a given requirement on the decoder error exponent. The resulting excess rate exponent is then evaluated for the optimal rate function. Alternating minimization algorithms are provided for the calculation of both the optimal rate function and the excess rate exponent. It is thus exemplified that, compared to fixed-rate coding, larger error exponents may be achieved using variable-rate coding, at the price of a finite excess rate exponent. Index Terms Slepian-Wolf coding, method of types, error exponents, excess rate exponent, alternating minimization, source uncertainty.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

IRWIN AND JOAN JACOBS CENTER FOR COMMUNICATION AND INFORMATION TECHNOLOGIES Large Deviations Analysis of Variable-Rate Slepian-Wolf Coding

We analyze the asymptotic performance of ensembles of random binning Slepian-Wolf codes, where each type class of the source might have a different coding rate. In particular, we first provide the exact encoder excess rate exponent as well as the decoder error exponent. Then, using the error exponent expression, we determine the optimal rate function, namely, the minimal rate for each type clas...

متن کامل

IRWIN AND JOAN JACOBS CENTER FOR COMMUNICATION AND INFORMATION TECHNOLOGIES Statistical Physics of Random Binning

We consider the model of random binning and finite–temperature decoding for Slepian–Wolf codes, from a statistical–mechanical perspective. While ordinary random channel coding is intimately related to the random energy model (REM) – a statistical–mechanical model of disordered magnetic materials, it turns out that random binning (for Slepian–Wolf coding) is analogous to another, related statist...

متن کامل

Sequential decoding for lossless streaming source coding with side information

The problem of lossless fixed-rate streaming coding of discrete memoryless sources with side information at the decoder is studied. A random time-varying tree-code is used to sequentially bin strings and a Stack Algorithm with a variable bias uses the side information to give a delay-universal coding system for lossless source coding with side information. The scheme is shown to give exponentia...

متن کامل

Analysis of Remaining Uncertainties and Exponents under Various Conditional Rényi Entropies

In this paper, we analyze the asymptotics of the normalized remaining uncertainty of a source when a compressed or hashed version of it and correlated side-information is observed. For this system, commonly known as Slepian-Wolf source coding, we establish the optimal (minimum) rate of compression of the source to ensure that the remaining uncertainties vanish. We also study the exponential rat...

متن کامل

On the redundancy of Slepian--Wolf coding

In this paper, the redundancy of both variable and fixed rate Slepian–Wolf coding is considered. Given any jointly memoryless source-side information pair with finite alphabet, the redundancy of variable rate Slepian–Wolf coding of  with decoder only side information depends on both the block length and the decoding block error probability , and is defined as the difference between the minimum...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • IEEE Trans. Information Theory

دوره 61  شماره 

صفحات  -

تاریخ انتشار 2015